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Abstract — We are concerned with input-to-state stability 
(iss) of randomly switched systems. We provide preliminary 
results dealing with sufficient conditions for stochastic versions 
of ISS for randomly switched systems without control inputs, 
and with the aid of universal formulae we design controllers for 
iss-disturbance attenuation when control inputs are present. 
Two types of switching signals are considered: the first is 
characterized by a statistically slow-switching condition, and 
the second by a class of semi-Markov processes. 

Index Terms — randomly switched systems, input-to-state sta- 
bility, multiple iss-Lyapunov functions, universal formula for 
feedback stabilization. 

I. Introduction 

SINCE its introduction in [1] the concept of input-to- 
state stability (iSS) has received widespread attention 
on both theoretical and practical fronts; see [2] for a recent 
detailed discussion. The ISS property characterizes behavior 
of the state trajectory of a deterministic nonlinear system 
perturbed by bounded disturbance inputs; as such it provides 
a framework for robustness analysis of nonlinear systems. 
Initially stated for deterministic inputs, various extensions 
of the ISS property have been made for inputs modeled 
as random processes, one of which is exponential input-to- 
state stability [3]. The ISS property has been employed in 
constructive ways for stability analysis, stabilizing feedback 
controller synthesis, adaptive control schemes, etc. 

With the growing interest in the theory and applications of 
hybrid systems, considerable effort has been directed towards 
understanding the behavior of switched systems. A switched 
system has two ingredients: a family of subsystems, and a 
switching signal which specifies the active subsystem at each 
instant of time. An important control-theoretic issue is that of 
stability and stabilization of these systems, and a number of 
interesting techniques have evolved over the past two decades 
to deal with this; for a discussion see, e.g., [4, Chapters 2, 3]. 
More recently, looking beyond stability, robustness and ISS 
properties of deterministic switched systems have received 
attention; see [5] and the references therein. There appears 
to be a common thread of slow switching in these results. 
That is to say, if the constituent subsystems are each ISS and 
the switching is sufficiently slow, then the switched system 
is also ISS. 

In this article we are concerned with ISS of randomly 
switched nonlinear systems, i.e., ISS properties of switched 
systems whose switching signal is a random process. We 
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provide preliminary results dealing with sufficient conditions 
for a stochastic version of ISS of these systems. Two types of 
switching signals are considered; the first is characterized by 
a statistically slow switching condition, and the second is a 
class of semi-Markov processes. For these classes of switch- 
ing signals it is difficult to apply traditional approaches which 
rely on an infinitesimal (or extended) generator [6], for either 
there is little information available about the parameters of 
the switching signal, or there is strong dependence on past 
history of the process. 

The approach pursued here employs multiple ISS- 
Lyapunov functions in the spirit of our earlier works [7], [8] 
on stability analysis of randomly switched systems without 
inputs. Our approach highlights the interaction of determin- 
istic dynamical systems with the stochastic switching signal. 
The switching signals considered here are adopted from these 
articles, but the analysis in the presence of inputs as we carry 
out here is more involved. 

With the analysis results in hand, we turn to control syn- 
thesis. Two types of controller architectures are considered: 
in the first case the controllers depend on both the switching 
signal and the state, and in the second case the controllers 
depend only on the state. The technical tools are off-the- 
shelf universal formulae for ISS disturbance attenuation [9] 
and our analysis results. To the best of our knowledge this 
is the first time that ISS under random switching is being 
studied. 

The article is organized as follows. In S]II]we fix notations 
and define our property of interest. The analysis results are 
given in Sjllll a proof of one result is sketched in i llVI and 
the synthesis results are presented in [JV] We conclude in ilVIl 
with a short discussion of the case of Markovian switching 
signals. 

II. PRELIMINARIES 

Let M^o [0, cx3[, ||-|| denote the Euclidean norm on 
R", and |[/|[^ denote the essential supremum norm of the 
function / on the set A C R^o- Recall that a function 
a : M^o — ^ R^o belongs to class-A;] if a is monotone 
increasing, continuous, and a{0) = 0. Also, a belongs to 
class-/Coo if a G /C, and a y oo. A function /3 : R^q — > 
R^o belongs to class-/C£ if (3{-,s) G K, for each s and 
•) \ for ^^ch r. We let x A y := minjx, y} and 
X W y :~ maxjcc, y} for .t, y G R. 

Let (51, ^, P) be a probability space [10], with ft the set of 
events, ^ a sigma-algebra on 51, and P a probability measure 
on (51, ^?). We let E[-] denote mathematical expectation 
and E"^ [ • ] (or E [ • | 5^'] ) denote conditional mathematical 



expectation given a sigma-subalgebra of ^. We let P'^ ( • ) 
(or P( • \^')) denote conditional probability given 

A. Randomly switched systems with disturbance inputs 

Let V := {1, . . . ,N} be a finite index set, and for each 
i G V let us consider the system 

i = h{x,d) (1) 

where fi : M" x M.'^ — > R" is a continuously differentiable 
vector field, /»(0,0) = 0. We allow d : R^o — > R*^ to 
be a measurable, locally essentially bounded function of 
time; this ensures local existence and uniqueness of solutions 
of ([Til. Let (T be a cadlag stochastic process (i.e., a stochastic 
process whose sample paths are continuous from the right 
and possess limits from the left) on (il, ^) taking values in V. 
We assume that for each t ^ and each G there exists 
a strictly positive number e{t,uj) such that cr(i + s,uj) ~ 
a{t,uj) on [t,t + e{t,uj)[. Under this condition we know [11, 
Theorem T26, p. 304] that the filtration {^t)t^o generated 
by (T is right-continuous, and we augment with all P- 
null sets. We say that <t is a random switching signal, and it 
generates the randomly switched system from the family ([T]i 
given by 

x^Uix,d), (x(0),a(0)) = (xo,(To), t^O, (2) 
where xq g R". 

B. Input-to-state stability 

Input-to-state stability (ISS) was formulated for a single 
system in [1]; let us state the definition corresponding to the 
i-th member of the family defined above. 

The system ([T]i is input-to-state stable if there exist func- 
tions Pi G ICC and 7^ G /Coo such that for every xq G M" 
and measurable and locally bounded input d, the estimate 

||x(OIKA(||.To||,t)+7.(l|d||[o,i[) (3) 

holds for all t ^ along solutions of ([T]i- 

Definition 1: The system (|2|i satisfies an ISS in Li esti- 
mate at switching instants if there exist functions /3 G JCC 
and a, 7 G /Coo such that for every xq G M", every 
measurable and essentially bounded input d, the estimate 

E[a(||x(r,)||)] ^m\xohi^)+l{\\dhJ (4) 

holds for all G N along solutions of (|2]i. O 
Notice that the expectation on the left hand side involves 
a class-/Coo function a. In the absence of randomness this 
statement in terms of a is equivalent to the statement that 
||a;(i)|| ^ /3'(||xo||,i) + 7'(IMII[o *[) for some functions 
f3' G ICC and 7' G /Coo, where we have employed a weak 
triangle inequality for class-/Coo functions^ In the context 
of randomly switched systems, however, without further 
assumptions on a one cannot conclude that E[||a;(t)||] ^ 
/3'(||xo|| ,t) +7'(||rf||[o t[) from ©. However, it is often the 
case that we get polynomial functions of the state inside the 

'The weak triangle inequality for a function 7 G /Coo is: 7(ri + r2) ^ 
7(2(ri V r2)) < 7(2ti) + 7(2r2). 



expectation, which in general yields stronger bounds. For 
instance, if the function a is quadratic, it is convex, and an 
application of Jensen's inequalit}@ leads to the last inequality. 

Let us also note that Definition [T] does not claim ISS 
of every sample path of the system (|2|i; the qualitative 
and quantitative aspects of this definition do not concern 
information about individual trajectories. 

Suppose that ([U is ISS for each i G V. Then by definition 
there exist functions G ICC and 7^ G /Coo such that (O 
holds along solutions of the i-th subsystem. However, with- 
out further stipulations on a, in general it is not true that the 
switched system generated by a from the family {fi}i^-p 
retains the ISS property (i.e., there will exist unique functions 
/3 G ICC and 7 G /Coo such that ^ holds for any trajectory of 
the switched system (|2|i). In j jllll we consider different classes 
of switching signals for which we give sufficient conditions 
for different types of iss-type estimates. 

III. Analysis Results 

A. Statistically slow switching 

We assume no more structure of the switching signal 
than a slow switching condition, which is reminiscent of the 
switching rate of a Poisson counter A similar condition was 
employed in the main theorem of [7], where we dealt with 
stability under no disturbance inputs and slow switching. We 
also assume that each member of the family of subsystems 
is ISS. First a piece of notation: let Ncr{t2,ti) denote the 
number of jumps made by a on the interval ^2] ^ K^o, 

Recall that we have (51, i?, (i?t)t^Oi P) as a complete 
filtered probability space satisfying the usual conditions. A 
[0, cx)]-valued random variable r is an {dt)t^o-stopping time 
if {t ^ t} G dt for each t ^ 0. A random variable r' is 
an {^t)t^o-optional time if {t' < G S't for each < > 0. 
It is quite clear that an (5^t)(^o-optional time is a {St)t^o- 
stopping time. It is a standard result that if {dt)t^Q is a right- 
continuous filtration, every (^Jt)t^o-stopping time is also an 
(5^i)t^o-optional time. For details see, e.g., [10]. 

Definition 2: The switching signal a is said to belong to 
class G if the following condition holds; there exist A, A > 
and fco G NU {0}, such that for every (^Jt)t^o-stopping time 
t' and for all k ^ 0: ^ 

P^*' (NJf + s,t') = fc) c-^-'-^^. O 
_ _ k' 
Note that if A = A and fco = 0, then Definition |2] gives 

the jump rate of a stationary Poisson process. 

We have the following 

Lemma 3: If <t belongs to class G, then (Ti)igN is almost 
surely divergent. 

One can prove this by estimating the expected value of 
Na-{t,0) from the bound in Definition |2] for a fixed t ^ 
(since each fixed t is an (5^t)f^o-optional time), which is 
readily seen to be finite. See also [13, Chapter 3] for an 
alternative argument. 

'Jensen's inequality [12] states that if X is an integrable random variable 
and : R > R is a convex function, then (/)(E[X]) ^ E[(/)(X)] . 



Our results employ a family of iSS-Lyapunov functions; 
the following assumption collects the properties we require 
from them. The analysis will proceed with the aid of ISS- 
Lyapunov-like functions^ The following assumption collects 
the properties we shall require from them. 

Assumption 4: Suppose that there exist continuously dif- 
ferentiable functions Vi : M" — > Kjjo, i ^ V, functions 
C(i,a2,x G ^oo, and numbers ^ ^ 1, A; e A C M, z g T', 
such that for all {i, x, d) E V x R"^ x R'^ we have 
(Vdl) ^ V^{x) ^ a2(||x||); 

(Vd2) ^{x)Mx,d) < -A,K(x) +x(IMII); 
(Vd3) V^x) ^ liV.ix). 

Note that if we allow A to include negative numbers, then 
not all Ai's need to be positive, which in turn means that not 
all subsystems are required to be ISS. 

The function Vi in (Vdl) and (Vd2) above is called an ISS- 
Lyapunov function for the z-th subsystem. If A consists of 
positive real numbers, (Vd2) is equivalent to each subsystem 
being ISS. Let us note that conventionally ISS-Lyapunov 
functions are defined in a little different way, for instance, 
the right-hand side of (VL2) is -Q!'(||a;||) + x'(||d||), or the 
right-hand side of (VL2) is — q;'(||2:||), for G ^oo, but 

they are equivalent to (VL2), as proved in [14]. 

Theorem 5: Consider the switched system (|2|, and sup- 
pose that 

(Gl) a belongs to class G; 

(G2) Assurnption m holds with A = {Ao}, Ao > 0; 
(G3) ^i < (A + Ao)/A. 

Then there exists a monotonically nondecreasing sequence 
(Ti)jgN of (5't)t5jo -optional times with limt^oo Ti = oo a.s., 
and functions f3 G ICC, a,jG ICoo, such that 

E[a(||a;(t)||)l{te[T._i,T,[}n{T._i<oo}] 

^/3(||xo|l,i)V7(|M||R^J (5) 

for all t ^ and i G N. 

The proof of Theorem |5] is rather long, and may be found 
in [13, Chapter 3]; we sketch the main steps in ijlVI See also 
i jlll-CI below for a discussion. 

B. A class of semi-Markov switching signals 

In this subsection we assume cr possesses more structure 
than being statistically slow-switching. Let Si := ti — ri_i 
for i G N be the i-th holding time, (Ti)igN being the sequence 
of switching instants. 

Definition 6: The switching signal a is said to belong to 
class UH if it satisfies: 

(UHl) the sequence {Si)i^m of holding times is a collection 
of i.i.d uniform- (T) random variables; 

(UH2) the sequence (cr(Ti))igNu{o} of values is i.i.d with 
P(cr(ri) = i) = Qj for some qj g]0, 1[, j G V; 

(UH3) the two sequences (S'i)igN and (cr(Ti))igN are mutu- 
ally independent. O 

^^Notice that since we do not always require, (as in i]III-Bl every 
subsystem to be ISS, these functions are not ISS-Lyapunov functions in 
the strict sense of the term. 



The class UH of switching signals is simply a representa- 
tive example of the class of semi-Markov switching signals 
that we can treat in our framework; see [13] for other classes 
of switching signals and related discussion. 

Lemma 7: For switching signals of class UH, the se- 
quence (Ti)igN is almost surely divergent. 

The above lemma can be established by appealing to the 
Strong Law of Large Numbers [15, Chapter 2]; see also [13, 
Chapter 2] for alternative arguments. 

Theorem 8: Consider the switched system (|2]i. Suppose 
that 

(Ul) cr belongs to class UH; 

(U2) Assumption E] holds with A = M; 

Then (O satisfies an ISS in Li estimate at switching instants. 
C. Discussion 

The results above fall short of being satisfactory. Indeed, 
perhaps the most natural adaptation of the ISS concept to the 
stochastic case would involve bounds of the type 

E[a(||x(i)||)] ^Pi\\xoht)+-f{\\d\\^J (6) 

for all xq G R'\ t ^ 0, and essentially bounded inputs d. 
However, the technical difficulties, particularly in the absence 
of Markovian assumptions on cr, are formidable. Let us 
consider switching signals belonging to class G. If B denotes 
the ball around the origin whose radius is and B' 

is a larger concentric ball, then the solution trajectory a;(-) 
enters B and exits B' at random instants, as defined in (Q; 
the sequence (Ti)igN in ® is actually this set of random 
instants. There is no further structure which prevents the 
number of exit/entry times from increasing at least linearly 
with time t (the linearity follows at once from the observation 
that the set of vector fields {fi}iev is locally Lipschitz, 
and that < oo). It is also clear that estimates for 

the probability distribution of the holding times are not 
available. Hence "gain-margin" type arguments appear to be 
the only mode of attack, as we pursue in i llVI As asserted in 
Theorem |5] it is possible to get bounds on the expectation 
of the state at some given time, restricted to each of these 
random excursion intervals, but gluing these estimates to get 
a uniform bound for a given time t is a difficult problem, 
and in our case it is yet unsolved. 

On the other hand, in the case of switching signals of class 
UH, the holding times are explicitly characterized, but the 
chief issue is that of obtaining an estimate for E[Q;(||a;(i)||)] 
from an ISS estimate in Li at switching instants. To wit, there 
can potentially be indefinitely many jumps of a before and 
after a given time t; therefore countably many simultaneous 
interpolations are needed to get an estimate of E[a(||a:(i)||)] , 
and such an interpolation is again a difficult problem. Unlike 
in the deterministic case, one is necessarily forced to work 
with random intervals. 

Let us also note that iss-type estimates "in probability" 
for diffusion processes have appeared in the Uterature, for 



instance, in [16, Theorem 4.2], and more recently in [17, 
§2]. Although the system models in the above references 
differ from ours, the essential technical difficulties remain 
the same. Unfortunately, these difficulties were not realized 
in the aforesaid references, and the claims made in both of 
them are still open. 

IV. Proofs 

Proof of Theorem\5\(Sketch). The argument is divided into 
five steps for convenience. We shall employ the equivalent 
"gain-margin" characterization [2] of ISS of the individual 
subsystems; see [13, chapter 3] for a more detailed proof. 

Step 1. Let us fix an essentially bounded disturbance input 
signal d with > 0, an initial condition xq G M", and 

define the open sets Ci {z e M" | ||2;|| < p(MIIm>o)} 
and Cz := {z e K" | ||z|| < ?/p(|M||r> J }, where >0 is 
chosen such that ai (77p(||d||jj^ J) > 2a2{p{\\d\\^^J) . Let 
us suppose that xq ^ Ci, the other case being similar We 
define the following sequence of random times taking values 
in [0, oo]: 

ti := inf{i > | x{t) G Ci}, 

ii := M{t > ii I x{t) e M"\C2}, 

(7) 

:= inf{t > I x{t) G Ci} for i G N, 
U+i := M{t > U+i I x{t) G M" \C2} for i G N, 

where it is understood that if any ii or ti is oo, then each of 
the definitions which follow it in the above sequence is set 
to oo. We note that both ti and ii are [0, oo]-valued {^t)t^o- 
optional times. 

Step 2. Pointwise on {t, Ti G [0, ii[j we have x{t), x{Ti) G 
M"\Ci, and from (Vd2)-(Vd3) we get 

E[T/.(,)(xW)l{*e[oi,[}] =«2(||xo||)c-(^°+^-^^)*. 
Therefore, 

E[K.(,)(x(t))i{,eMi[}] ^ mi^oht) yt ^ 0, 

where P{r,s) := a2{r)c~'^^, A := Ao + A — /iA > by 
(Gd3). 

Step 3. Pointwise on {t,Ti G H {ij < oo } for 

i,j G N we have x{t),x{Ti) G C2 by (|7]i and continuity of 
x{-). Employing (Vdl) leads to 

Vi G [tj,t;-[ V^^t)ix{t)) ^ a2(w(|ld|U^J). 
whenever tj < 00. Taking expectations we arrive at 



E 



K-(t)(a;(i))l{£^.<oo}n{te[tj,tj[} 

Mvp{\\dhJ)P{{t e [t„t;-[} n {i, < w}) . 



Step 4. Pointwise on {t,Ti G [tj,<j-|-i[} n {ij < 00} for 
i,j G N we have 



a(t) 



dx 



{X{t))f„f^t){x{t),d{t)) -AoKx(t)(.T(t)), 

VfcGT' V,^^^){x{n)) ^ ,xVk{x{n)) 



(8) 



in view of (Vd2)-(Vd3). Therefore, 



V'o-(t)(a;(0)l{t6[tj,tj+i[}n{tj<oo} 



E 



(9) 



It can be shown that the process {yn{ij+s){^{^j + 

s))l{t,+s<t,+i}n{t,<oo}),^o is a nonnegative {^Si^+X^o 
potential. Further detailed calculations lead to 



E["Kx(t)(-^W)l{tefc,t,+i[}n{t,<oo}J < 7 

where we let 7(r) := (1 + 1/ 5)a2{'rip{r)). 

Step 5. It remains to define the sequence (Ti)igN of 
(5't)t^o-optional times. Letting T2k-i ■= ik and T2k ■= 4, 
/c G N, we see from Steps 2 through 4 that 

E[Vo-(t)(a;(t))l{4g[T,_i,T,[}n{Ti_i<oo}] 

^m^oht)V-f{\\d\\^J, 

which proves the claim. □ 
Proof of Theorem^ (Sketch). Fix G N, and let k' := 



£V A, 



1 



/ 



In view of (Vd2), pointwise on {s G [ti, ri+i[}, i G N, and 
applying (Vd3) at t = t^+i. 



Iterating the above inequality from i = {] through i = v — 1, 
we get 

v-l 

z^O 

y—1 _4 I — 1 



^^x(iidiu,jE 



^-(-.) ° 



-^,j(T,)(7"i + l-T3) 



V-l 

n 



--'>,J(T.)(T3 + 1-Tj) 



(10) 



The expectation of the first term on the right-hand side 
of ( [Tol l can be evaluated as 



^''KT(o)(a;o) Jl e" 



i=0 



(11) 



by utiHzing (Vdl) and (UH1)-(UH3). Also, from (UH3) we 
have 



i=i+i 



1 _ Q-^<T(xi)Si+l 



A 



(12) 



Now for each j £ N we have 



and for each i gN, 



1 



A, 



kev 



1 - c- 



XkT 



(13) 



(14) 



Substituting the right-hand sides of (fT4b and ( fT3] l back 
into ( fT2] i and simplifying, we see that 



E[K.(.„)(x(r,))] ^a2i\\xo\\) J2 
+ k'x 



m (1 



Now, letting j{r) := fc'x(r) and /3(r, s 

„ /xgj(l-e~^J^) 



7? : 



(15) 

a2('')?7^, where 
, an application of (Vdl) on the 



left-hand side of dot immediately proves the assertion. □ 
V. Control synthesis for iss disturbance 

ATTENUATION 

We look at two different controller architectures, namely, 
one in which the controller is mode-dependent, and the other 
in which the controller is mode-independent. That is to say, 
in the first case, u is a function of both the state x and 
the switching signal a, while in the second case u is just a 
function of x. 

A. Mode-dependent controllers 

Consider the affine-in-control switched system perturbed 
by a disturbance signal 



X = fa{x,d) + \] gcr^i {x)u. 



i=l 



xo, 



t ^ 0, 



(16) 

. . , TO, are the (scalar) 
V and gj,i : — > 
to}. 



where x g R" is the state, Ui, i = 1, 
control inputs, fj : M" x R'' — > : 
M" are smooth maps for each j E V, i G {1, 
Let C be the set where the control u := [ui, . . . , 
takes its values. For the moment we let C be a subset of 
M™ containing the origin. With a feedback control function 
kc{x) := [ua^iix), . . . TUa^rn{x)Y , the closed-loop system 
stands as 

m 

X = fa{x,d) +'^ga^i{x)k„.i{x), x(0)=xo, < ^ 0, 
1=1 

(17) 

We let the switching signal cr be a stochastic process as 
defined in ijlll and let xq ^Q. 

Our goal is to choose a control function so that ( fTTl ) 
satisfies some iSS in Li estimate at switching instants. We 
shall appeal to our analysis results of ijllll and universal 
formulae for ISS disturbance attenuation to achieve this 
objective. 

Universal feedback control functions attaining ISS dis- 
turbance attenuation for nonlinear systems affected by dis- 
turbances and possessing control inputs were constructed 



in [9]. The results in that article rely on universal formulae 
for asymptotic feedback stabilization of nonlinear systems; 
applications include systems in which the control takes 
values in various restricted control sets, and a universal 
formula is available. In our illustrative result below we utilize 
off-the-shelf universal feedback control functions for ISS 
disturbance attenuation from [9]. The next proposition is a 
typical illustration of such a result. 

Let us define the map : M x M'" — > M given by 



a-\- \Ja? 



-b ifb^ 0, 
otherwise, 



the function Wj{x) := [Lg. -^Vj{x), . . . ,Lg.^^Vj{x)], and a 



map Wj 



with values chosen such that it is 



smooth away from and continuous at 0, and 



1?^ 

ox 



{x)f,ix,d)~xi\\d\\) \+X,V,{x) ^ W,ix) 



^ max < 



ix)f,ix,d)-x{\\d\\)\+2X,V,ix) (18) 



for all X e M", j G V. 

Proposition 9: Consider the system ( fT6l ) with C = M™. 
Suppose that a belongs to class UH, and 

(Cdl) (Vdl) of AssumptionSholds; 
(Cd2) (Vd3) of Assumption g] holds; 

(Cd3) 3a,x e Koo, 3 e A = E, j e V, such that 
Mx e M"\{0}, Vd e R'' and Vj e we have 



Y,^g^..V,{x)iH Ux([|d||); 



(Cd4) Ve>035>0 such that if x{^ 0) satisfies < 5, 
then 3 u G R", ||u|| < e, such that VjeV 



max<; ^(a;)/j(x, d) - x(IMII) 



(Cd5) (U3) of Theorem ID hold. 

Then under the feedback control function 



k,{x) = ^{w^ix),w;^ix) 



(19) 



the system (TT\ satisfies an ISS in Li estimate at switching 
instants. 

The proof relies heavily on the proof of [9, Theorem 3], 
see [13, Chapter 3] for details. 



B. Mode-independent controllers. 

Consider the affine in control switched system ( fT6] l. Let 
k{x) = [fci(x), . . . , km{x)Y be a feedback control function, 
with which the closed-loop system stands as 

m 

X =^ fa{x,d) + '^g„^i{x)ki{x), x{Q) = x^, i ^ 0. (20) 

i=l 

We let the switching signal cr be a stochastic process as 
defined in iJIIl and let .tq ^ 0. 

Our objective is to choose a control function k such 
that ( |20] | satisfies an ISS in Li estimate at switching instants, 
for some class-A^oo function a. 

Proposition 10: Consider the system ( fTSI l with C = R™. 
Suppose that a belongs to class UH, and 
(CUdl) (Vdl) and (Vd3) of Assumption S holds; 
(CUd2) there exists a control function k : R" — > C, such 
dV 

that —^{x){f,{x,d)+g^ix)k{x)) -X,V,{x) + 
x(||(i||)1^or every ieV, x e R"; 

(CUd3) ^ ^^^^ < 1. 

Then under k the system (fTSI l satisfies an ISS in Li estimate 
at switching instants. 

The assertion follows immediately by first observing that 
the closed-loop system is ( l20l i. and then applying Theorem [8] 
to (EOI). 

VI. Remarks on Markovian Switching Signals 
We have established sufficient conditions for different ISS- 
type properties of the randomly switched system (|2|i under 
different classes of switching signals. Let us reiterate that 
for switching signals of class G and UH considered here, 
it is difficult to write an infinitesimal generator, since there 
is either too little information about the parameters of the 
switching signal, or a strong dependence on its past history. 
For switching signals coming from continuous-time Markov 
chains it is possible to employ the infinitesimal (or extended) 
generator to derive conditions for stability. We get stronger 
bounds by this route, as shown in [13, Chapter 3]. Indeed, 
we have 

Theorem 11: Consider the system (|2]i, and suppose that 
(T is a continuous-time Markov chain with generator matrix 
Q = [gijjNxN- Moreover, suppose that there exist functions 
V -.V xW^ — > R^o. y{i^ •) is continuously differentiable 
for each i, ai, a2, p S /Coo, and a constant Ao > 0, such that 

. aii\\x\\)^Vii,x)^a2i\\x\\), 

• CV{i,x) < ~XoV{i,x) whenever ||x|| ^ p(||(i||). 
Then the inequality in (|6]l holds for some /3 E ICC and some 
a,7 e /Coo- 

For definitions of Markov chains, (local) martingales, 
and martingale problems, see, e.g., [10]. The operator C is 
defined in terms of an appropriate martingale problem as 
follows. Let ft, : P X R" — > R be a function such that there 
exists a measurable function h : P x R" — > R such that 
the process 

[h{a{t),x{t)) - h{ao,xo) ~ / h{a{s),x{s)) ds\ 
\ Jo J t^o 



is a mean-zero (S't)* 5,0 -local martingale. We define 
Ch{i, x) := h{i,x), where C is the extended generator [6] 
corresponding to the Markov process {a{t), x{t))t^o. Of 
course, finding the class of functions h for which such a 
h exists is a nontrivial matter, but it is usually not difficult 
to find a subclass. Often the operator C is defined in terms 
of a differentiation operation, namely, 

Ch(i x) - lim EN^(^ + M,a;ft + /i))|At] 

' hlO h ' 

where At := {(a{t),x{t)) = {i,x)}, and /i : P x R" — > R 
is a function that is pointwise continuously differentiable on 
the set V. 

A similar approach relying on the solution to appropriate 
martingale problems can be adopted if ct is a general marked 
point process [11] with suitable stochastic jump intensities, 
and will be reported elsewhere. Another interesting direction 
of work concerns establishing iSS-type estimates "in proba- 
bility" of (|2]l, such as those formulated in [16], [17]. 
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